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Abstract. This paper describes a method for the onUne state estimation of 
systems described by a general class of linear noncausal time- varying difference 
descriptor equations subject to uncertainties. The method is based on the 
notions of a linear minimax estimation and an index of causality introduced 
here for singular difference equations. The online minimax estimator is derived 
by the application of the dynamical programming and Moore's pseudoinverse 
theory to the minimax estimation problem. It coincides with Kalman's filter for 
regular systems. A numerical example of the state estimation for 2D noncasual 
descriptor system is presented. 

Keywords Kalman filtering, online state observer, guaranteed estimation, 
descriptor systems, singular systems, DAEs. 

1. Introduction 

There is a number of physical and engineering objects most naturaUy modelled 
as systems of differential and algebraic equations (DAEs) or descriptor systems: mi- 
crowave circuits [1] , flexible-link planar parallel platforms [2] and image recognition 
problems (noncasual image modelling) [4] . DAEs arise in economics [5] . Also non- 
linear differential-algebraic systems are studied with help of DAEs via linearization: 
a batch chemical reactor model [3] . 

On the other hand there are many papers devoted to the mathematical process- 
ing of data obtained from the measuring device during an experiment. In particular, 
a problem of the observer design for discrete-time descriptor systems was studied 
in the [5]- [8], the guaranteed state estimation for a linear dynamical systems was 
investigated in the [9]. In the [6] the authors derive a so-called "3-block" form for 
the optimal filter and a corresponding 3-block Riccati equation using a maximum 
likelihood approach. A filter is obtained for a general class of time-varying de- 
scriptor models. The measurements are supposed to contain a noise with Gauss'es 
distribution. The obtained recursion is stated in terms of the 3-block matrix pseu- 
doinverse. 

In the [7] the filter recursion is represented in terms of a deterministic data fitting 
problem solution. The authors introduce an explicit form of the 3-block matrix 
pseudoinverse for a descriptor system with a special structure: so their filter coin- 
cides with obtained in the [6]. 

In this paper we study an observer design problem for a general class of linear 
noncasual time- varying descriptor models with no restrictions to a system structure. 
Suppose we are given an exact mathematical model of some real process and the 
vector Xk describes the system output at the moment k in the corresponding state 
space of the system. Also the successive measurements yo . . .yk ■ ■ ■ of the system 
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output Xk arc supposed to bo available with the noise go . . . gk ■ ■ ■ of an uncertain 
nature"^. Further assume that the system input fk, start point q and noise gk are 
arbitrary elements of the given set G. The aim of this paper is to design a minimax 
observer k Xk that gives an online guaranteed estimation of the output Xk on the 
basis of measurements yk and the structure of G. In [8] minimax estimations were 
derived from the 2-point boundary value problem with the conditions at i = (start 
point) and i = k (end point). Hence a recalculation of the whole history xq ■ ■ - Xk 
is required if the moment k changes. Here we derive the observer {k,yk) Xk 
by applying dynamical programming methods to the minimax estimation problem 
similar to posed in the [8]. We construct a map x that takes {k,yk) to Xk making 
it possible to assign a unique sequence of estimations xq ■ ■ ■ Xk ■ ■ ■ to the given 
sequence of observations yo ■ ■ - yk ■ ■ ■ in the real time. A resulting filter recursion is 
stated in terms of the pseudoinverse of positive semi-defined nx n- matrices. 

2. Minimax estimation problem 
Assume that Xk G K" is described by the equation 

(1) Fk+iXk+i-CkXk= fk,k = 0,'i-,---, 
with the initial condition 

(2) Foxo = q, 
and yk is given by 

(3) yk = HkXk+gk,k = 0,1,..., 

where Fk , Ck are m x n-matrices, Hk ispx n-matrix. Since we deal with a descriptor 
system we see that for any k there is a set of vectors xf... x° satisfying (1) while 
fi = 0,q = 0. Thus the undefined inner infiuence caused hy x^. . .x^ is possible to 
appear in the systems output. Also we suppose the initial condition q, input {fk} 
and noise {gk} to be unknown elements of the given set^ 

oo 

(4) G{q, {fk}, {gk}) = {Sq,q) + Y.{Skfk,fk) + {Rk9k,9k) ^ 1 



where S,Sk,Rk are some symmetric positive-defined weight matrices with the 
appropriate dimensions. The trick is to fix any A/'-partial sum of (4) so that 
{fk}, {9k}) belongs to 

■•={{<lAfk},{9k}): 

(5) ^"^ ^ 

{Sq, 9) + {Skfk, fk) + ^{Rk9k,9k) ^ 1} 
fe=o fe=o 

Then we derive the estimation .tat = v{N,yiq ,xn-i) considering a minimax esti- 
mation problem for 'S^ . Lets denote by A/" a set of all {{xk}, q, {fk}) such that (1) 
is held. The set '^y is said to be a-posteriori set, where 

■.= {{xk}:{{xk},q,{fk})eM, 

(6) 

iq,{fk},{yk-HkXk})e^''} 



^For instance we do not have a-priory information about its distribution. 

^Here and after (■, •) denotes an inner product in an appropriate euclidean space, = {x, 
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It follows from the definition that '^y consists of all possible {xk} causing an 
appearance of given {yk} while {q, {fk}, {gk}) runs through Sf^. Thus, it's naturally 
to look for XN estimation only among the elements of Pn{^^), where Pn denotes 
the projection that takes {xq . . .xn} to x^. 

Definition 1. A linear function {1,xn) is called a minimax a-posteriori estimation 
if the following condition holds: 

inf sup \{i,XN) - {1,Xn)\ = 

sup \{£,Xn) - {i,XN)\ 

The non-negative number 

a{e,N)= sup \{i,XN) - {Xx^)\ 

is called a minimax a-posteriori error in the direction £. A map 

N ^ In = dim{e e K" : N) < +00} 

is called an index of causality for the pair of systems (l)-(3). 

Denote by A; a recursive map that takes each A; € N to the matrix Qh, 

where 

Qk = H'^RkHk + -Ffe[S'/s-i - Sk-iCk-iW^_y^C'j^_-^Sk-i\Fk, 

Qo = FqSFq + HqRqHo, Wk = Qk + C'l^SkCk 

Let A; H-» Tfe be a recursive map that takes each natural number k to the vector 
rk e M", where 

rk = F^S'fe-iCfc-i W^+_irfe_i + H'^Rkyk, 
ro = H^Royo 

and to each number z G N assign the number a^, where 

= ai-i + {Riyi,yi) - {W^Llri-l,r^-l), 

"0 = {Sg,g) + {Royo,yo) 

The main result of this paper is formulated in the next theorem. 

Theorem 1 (minimax recursive estimation). Suppose we are given a natural num- 
ber N and a vector £ G M" . Then a necessary and sufficient condition for a minimax 
a-posteriori error a{£, N) to be finite is that 

(10) Qt,QNi = e 
Under this condition we have 

(11) H^,N) = [l-aN + {Qt!rN.rN)]HQN^,¥ 
and 

(12) (^^) = (^,Q^r^) 

Corrolary 1. The index of causality In for the pair of systems (l)-(3) can be 
represented as In = rank((3jv)- 
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Corrolary 2 (minimax obsever). The online minimax observer is given by k 
Xk = Qk'''k and ^ 



(13) 



p(N) = min max ||a;jv 
[1 - ajv + (Qjv*jv,^iv)] 



a;jv I 



mmi{Xi{N)} 

where Xi{N) are eigen values of Qn. In this case all possible realisations of (1) 
state vector xn fill the ellipsoid Pjvl^jf') C M." , where 

(14) PNi%'') ^ {x : iQNX,x) - 2{QmXn,x) + aM ^ 1} 

Remark 1. // \min{H'^RkHk) grows for k = i,i + 1, . . . then the minimax esti- 
mation error p{k) becomes smaller causing Xk to get closer to thereal state vector 

Xk- 

In [7] Kalman's filtering problem for descriptor systems was investigated from the 
deterministic point of view. Authors recover Kalman's recursion to the time- variant 
descriptor system by a deterministic least square fitting problem over the entire 
trajectory: find a sequence {xo\k, . . . ,Xk\k} that minimises the following fitting 
error cost 

^k{{xi\k}o) = \\FoXo\k - gf + Wvo - HoXo\kf+ 



k 

El 

i=l 



FiXi\k - Ci-iXi_iik\\^ + \\yi - HiX, 



\k\ 



Fk 



assuming that the rank 



n. 



According to [7, p. 8] the successive optimal 



estimates {a;o|fe, . . . ,Xk\k} resulting from the minimisation of can be found from 
the recursive algorithm 

Xk\k = Pk\kFk{F + Ck-lPk-l\k-lC^-l)~^Ck-lXk-l\k-l 

+ PklkH'kRkVk, xq\o = -Po|o(-Fog + H^yo), 
(15) 1 
Pk\k = {Fk{E + Ck-iPk-i\k-iCk-i)~^ Pk + H'kHk) , 

-Po|o = {PqPo + HqHo)~^ 

Corrolary 3 (Kalman's filter recursion). Suppose the rank = n, and let k t-^ rk 
be a recursive map that takes each natural number k to the vector rk S M", where 

Tk = H'kyk + FlCk^i{C'k_^Ck-i + Qk-i)t-irk-u 

Then Q^rk = X/^^^ for each /c G where x^ij. is given by (15) and Ik = n. 

3. Example 



Let us set Hq 



_S_ J!fi_ n 

10 100 ^ 

1000 2^ 

1 TO 








,Fk 



Cfe 



[1 01 

Lo 1 oJ' 



lOOfe ^ 

0.005 150fc*g(/c) 
0.05 lOfe 



^We assume here that ^ 



: +00. 



RECURSIVE STATE ESTIMATION FOR NONCAUSAL DISCRETE-TIME DESCRIPTOR SYSTEMS UNDER UNCERTAINTIESB 



where q{k) = 1 if fc is odd and otherwise q{k) — 0. We derive the output Xk of (1) 
and Uk assuming fk, gu to be bounded vector-functions on the whole real axis. Also 
we set Rk = diag{ ^^^^j , 22(fe+i) ' 33(fc+i) ' 44(fc+i) J'' '^'^ = 35(^+1) ■ 7o(fc-i-i) i' 
S = diag{^,^}. 

We derive Xk from (8) and a-{ei, fc) from (11), - i-ort. Note that the rank ^^tti '^l 
3 and hk = 3, hk+i < 3. Thus £3,2/04-1 = 0, 

[1 - a2k+i + {Qtk+ir2k+i,r2k+i)]HQtk+i^^^-)^ = 

but 1x3,2/0+1 - ^3,2/c+il > 0. The dynamics of x,^kiXt,k, \X'i,,k - Xi^k\ and a{ei, fc) is 
described by figures 1-2. 




Figure 1. N ~ 100, output Xi^k (solid) and observer Xi^k (dashed) 
to the left; 
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Appendix A. Proofs. 
Proof. Proof of Theorem 1 . By definition, put 

Ho 0„,. ... 0„,.s / Po - 2" 



Opn Hi ... Op 



Co Fx 0,„„ ... 0„„ 0„ 
Om„ -Ci Fa ... 0™„ 0„ 



,F = 

^Op„ Op„ ... Hn / \0m„ Om„ 0,^„ -Cn 
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" 2:0 " 




' yo ' 

VI 

V2 


_XN _ 




_VN _ 



r 1 1 




' go ' 


fo 




91 


fi 






-In-i- 




.9n _ 



X 



mathcalF = 



By direct calculation we obtain {£,xn) = {C,X), 

= {X:\\¥x\\l + \\y-mxg)^i}, 

where = {Sq, q) + Y.o~^{Skfk, fk), || • II2 is indused by Rk on the same way. 

This implies 

sup \{£,xn-xn)\= sup \{jC, X) - {jC, X)\ 

Denote by L the set i?[ f' h' ] . We obviously get 

£eL<^ sup A") -(£,;?)!< +00 

The application of Corollary 4 yields (10). Consider a vector £ G L. Clearly 
inf (L,X) < iCX) < sup (£, A"), e 

Let c denotes \{s.\x]^x^c§n{C,X) + inf_;fg<^N(£, A")). Therefore 
sup \{C,X)-{C,X)\ = 



^(s(£|^,^) + (s(-£|^-)) + |c-(AA')| 



hence 
(17) 



a(£,iV) = ^(s(£|^^j^)+s(-£|$^j^)), 



(s(£|^^7)-s(-£|^^j^)), 



where s(-|^^^) denotes the support function of 'Sy ■ Clearly, is a convex closed 

set. Hence the equality (£,<%*) = (^,a;jv) is held for some X e Thus, to 

conclude the proof we have to calculate s(£,^j^). Let 

(18) = {X ■■ ¥Xf + WHXf < /3;v}, 
where /3jv = 1 - ajv + {QtrVN, rjv) > 0. 

Lema 1. 

(19) s(£, = {£, Q+r^) + s(£|?C) 

It follows from the definition of that s{C\^i^) = s(-£|%^) hence (17) implies 

The application of Lemma 2 completes the proof. 
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Lema 2. 



(20) s{C\X) = 



Vl3^{Q+e,i)K[E - Q+Qn]^ = 0, 
+0O, [E - Q+Qn]£ ^ 



□ 



Let r/s denote M"-valued recursive map 

'''k = Fk{Sk-i - Sk-iCk-iP^_-^C'j^_iSk-i)fk-i+ 
(21) FlSk-iCk-iW+_^rk-i + H'kRkVk, 

ro = FqSq + HqUqUq, Pk = C'f.SkCk + Qk 



and set 



^{{Xk}) = \\FqXq - g\\l + ho - HoXoWl- 



N 



\WkXk - Ck-lXk-1 - /fc-l||fe_l + WVk - HkXkWl 

fc=l 

where \\g\\l = {Sg,g), \\fk\\l = {SkfkJk), = (Riyi,yi). 

Lema 3. Let x Xk be a recursive map that takes any k Cz N to Xk € K", where 
Xk = {ClSk{Fk+iXk+i - fk)+rk), 

\ / -I- 

XN = QnTn, 

Then 



min J({a;fe}) = J({ffe}) 



Proof. By definition put $(xo) := \\FoXo - g\\l + \\yo - HqXoWI 

^i{x„x,+i) := Ili^.+iXi+i - Qxi - fiWf + \\y,+i - H,+ix,+i\\f^-^ 
Then we obviously get 



N-l 



(23) ^{{xk}) = ^{xo) + 

i=0 

Let us apply a modification of Bellman's method^ to the nonlinear programming 
task 

3{{xk}) min 

By definition put 

hixi) :=min{$(a;o) + $o(a;o,a;i)} 
Using (7) and (21) one can get 

^{xo) = {QoXo,xo) - 2(ro, xo) + ao > 0, ao := \\g\\l + lbo||o 
On the other hand it's clear that 

ii{xi) = $(^o) + ^o{xo,xi) = {Qixi,xi) - 2{ri,xi) + ai > 0, 
where xq = P^{ro + Cl,So{FiXi - /o)) 

ai ■■= ao + WviWl + WfoWl - (P^iro - C^5o/o),ro - C^5o/o) 



^So-called "Kievskiy venyk" method 
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Considering £i{xi) as an induction base and assuming that 

£i-i{xi-i) = miii{^i-2{xi-2, Xt-i) + £t-2{xi-2)} = 

2:1-2 

{Qi-iXz-i,Xi-i) - 2(ri_i, Xi-i) + ai-i 
now we are going to prove that 

ii{xi) = mm{^i-i{xi-i,Xi) + £i-i{xi-i)} = 

(24) 

(^QiXi^ Xi^ 2(7*2, Xi^ Oii 

Note that [10] for any convex function {x,y) 1-^ fix,y) 

y m.m{f{x,y)\{x,y) : P{x,y) = y},P{a,b) = b 

is convex. Thus taking into account the definition of £i{xi) one can prove by 
induction that £i-i is convex and 

^i_i{xi_i,Xi) + £i_i{xi_i) ^ 

Hence^ Qi-i ^ 0, the set of global minimums ^'^-i of the quadratic function 

Xi-i ^ ^t-i{xt-i,Xi) + {Qi_iXi-i,Xi-i) - 2{ri-i,Xi-i) + a^-i 
is non-empty and Xi-i G "fi, where^ 

Xi.i = {Qi-i + CUSi-iCi-i)+{CUSi-i{FiXi - fi-,) + n-i) 
This implies 

{QiXi,Xi) - 2{ri,Xi) +ai, 

where 

ai = ai-i + {RiyuVi) + {Si-ifi-i, fi-i)- 

Therefore, we obtain 

min£jv(a;jv) =£n{xn) = an - {rN,QtirN),XN = QtrN 

XN 

SO that min{3,^} J({a;fe}) = J{{xk}). □ 
Corrolciry 4. Suppose jC = [0 . . .£]; then 

C€M[v' n']^[E- Q^Qn]£ = 

and 

|1[f' m']+Cr = iQ+£,£) 

Proof. Suppose Sk = E, Rk = E for a simplicity. If £ € .^[f' h' ] then 

F'j^ZN + H'j^UN = £, Fj^Zk + H',,Uk - C'kZk+i = (*), 

for some Zk G ]R™,Mfc G M^. Let's find the projection {{zk,Uk)}k=o vector 
{{zk,Uk)}k=o OT^^o the range of the matrix [^j. Lemma 3 implies 

zo = FqXo, Zk = FkXk - Ck-\Xk-i,Uk = HkXk, (**) 

^The function x 1-^ {Ax, x) — 2{x, g) + c is convex iS A = A' ^ 0. 

^The vector xt—i has the smallest norm among other points of theminimum. 
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where 

= Pki^^'k^k+lXk+l +rk- C',^Zk+l),XN = QtfVN, 

Tk = F^Cfe_iP+_irfc_i + F;,{E - Ck-iP^_,C'k_,)zk+ 

+ H'kUk,ro = F^ZQ + H'qUo, Pk = C'^Ck + Qk 

(*) implies rfc = Clzk+i,k = 0, . . . ,N - 1, tn = (- thus xn = Q^i, Xk = 
P+C'^Fk+iXk+i or Xk = $(fc, N)Q+e, 

<i>{k,N) = P+ClFk+i^k + l,N),^s,s) = E 

Combining this with (**) wc obtain 

Zk^iFkHk,N)^Ck-Mk-l,N))Q+£, 
(25) ^ ' 

Uk = Hk<P{k,N)Q+e,zo^Fo<^{0,N)Q+e 

By definition, put U{0) = Qo, 

U{k) = ^'{k - 1, k)U{k - l)$(fc - 1, k)+ 

H'^Hk + Fk{E - Ck-iP^_^Ci_,fFk 

It now follows that 

N 

||[r H']+£f = J2 P^f + P^f = iUiN)QU, QU) 



It's easy to prove by induction that Qk = U{k). 
Since 

C. e -R[f' h'] 

we obtain by substituting Zk,Uk into (*) 

F'j^ZN + H'j^UN = i 

On the other hand (7) and (25) imply 

F^ZN + H'f^UN =l^[E- Q+QnY = 
Suppose that [E — Q^Qn]^ = 0. To conclude the proof we have to show that 

{£,xn) = {Qt,e,QNXN) = 0,V[.To...a;7v] G ^[f,h] 

By induction, fix = 0. If Fqxq = 0, Hqxq = 0, then QqXq = 0. We say that 
[xo ...Xk]€ =yK[F,H] if 

FqXo = 0, HqXo = 0, FsXs = Cs-lXs-l,HsXs = 0, 

Suppose Qk-iXk-i = 0,V[a:o • ■ -a^fc-i] G ^[f,h] and fix any [xo-.-Xk] € =yK[F,H]. 
Then FkXk = Ck-iXk^ , H^Xk = 0. Combining this with (7) we obtain 

QkXk = Fl{E - Ck-iPt^C'k_^)Ck-iXk-i (*) 

We show that Qk > in the proof of Theorem 1. One can see that 

qLi, 

[(Cfc_iCfc_i + Qfc_i)+Cfc_i, (Cfe_iCfe_i + Qk-i^Qk-i] 

Since 

Ofe 1 C k 1 C'fc 1 Cfc 1 
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we obviously get 

Ck-iPk-iC'k-iCk-iXk-i = Ck-iXk-1 QkXk = 
as it follows from (*). This completes the proof. □ 

Proof. Proof of Lemma 1. Taking into account the definitions of the matrices F, H 
and (6) we clearly have 

= {X ■ \\¥xf + \\y - mx\\^ < 1} 

Let be a minimum of the quadratic function X UFA*!!^ + — HA"!!^. It now 
follows that 

%f = X + <^^ ^ s(£|SC) = (£, X) + s(£|%^) 
The application of Lemma 3 yields 

= (£,Q+riv) 

This completes the proof. □ 

Proof. Proof of Lemma 2. Suppose the function / : R" — » is convex and closed. 
Then [10] the support function s{-\{x : f{x) ^ 0}) of the set {a; : f{x) ^ 0} is given 

by 

s(^|{x:/(x)^0}) = clinf{Ar(^)} 

To conclude the proof it remains to compute the support function of '^q according 
to this rule and then apply Corollary 4. □ 

Proof. Proof of Corollary 3. The proof is by induction on k. For fc = 0, there is 
nothing to prove. The induction hypothesis is Pk-i\k-i = Qk-v Suppose S is 
n X n-matrix such that 5 = S" > 0, A is m x n-matrix; then 

(26) + A'A)-'^ = {E + ASA')-'^AS 
Using (26) we get 

(27) ASA' = [E + ASA']A[A'A + 5"^]"^' 

Combining (27) with the induction assumption we get the following 

E + Ck-iPk-i\k-iCk-i = 
E+[E + Cfe_iPfe_i|fe_iCiJ._ J X 

X Ck-i[Qk-i + C'fe_iC'fe-i]~^C'fe_i 
By simple calculation from the previous equality follows 

E — Ck-i{Qk-i + C'^-iCk-i)~^ = 
{E + Ck-iPk-i\k-iCk^i) ^ 

Using this and (7);(15) wc obviously get Q^^^ = Pk\k- 

It follows from the definitions that Qo^ro = XqIo- Suppose that Q^^l^rk-i = 
Xk-i\k-i- The induction hypothesis and (26) imply 

{E + Ck-lPk-l\k-lCk-l)~'^^k-lXk-l\k-l = 

Ck-i{C'k_iCk-i + Qk-i)k-\'''k-i 
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Combining this with (15), (16) and using Qj, ^ = P^^^ wc obtain 

Xk\k = Ql\FlCk-i{C'k_iCk-i + Qk-i)t-irk-i + H'^Vk) 
This concludes the proof. □ 

Proof. Proof of Corollary 2. li Ik < n then rank((3) < n hence Xmm{Qk) = 0. In 
this case there is a direction £ e M" such that &{(., k) = +oo. So p{k) = +oo. If 
Ik = n then we clearly have 

min max llxjv — ijvlP = 
min max | max xjv — ijv)|}^ = 
jmin max max \(i,XN — ijv)|}^ ^ 

|K||=l{£fc}G?f„" 

{max min max \U,xn — Xm)W'^ = 

[1 - ajv + {QifrN,rN)] max;((3^£,£) = 

IKII 

[1 - aiv + (Q^rjv,rjv)] 

min,{Ai(A/-)} 
On the other hand Theorem 1 implies 

max \\xm — ijvlP = 

{max max \U,xn — xn)W'^ = 

{ max [1 - ajv + (Q^rAr, rAr)]i(Q+^, £)3}2 

It follows now from Ijq = n that Sfj^ is a bounded set. 

The equality In = n implies [E — Q~^Qn] = for a given A''. It follows from 
Lemmas 1,2 that 

s{i\PN{%'')) = s{p^e\%'') = sm'') = 

(28) I 

for any ^ e M". By Young's theorem [10], (28), so that 

Pn{%'') = {x e m" : (x,£) ^ s{i\PN{%''))ye e M"} = 
{a; e : sup{(a;,f) - (£,fjv) - V^(Q^^,^)^} < 0} = 
{a; e K" : {Qnx, x) - 2{QnXn,x) + ajv < 1} 

□ 
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